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ABSTRACT 

The  derivation  of  an  approximate  summary  measure  which  would  relate  measurable 
photographic  parameters  to  judgments  of  target  interpretability  was  investigated.  An 
alternative  technique  for  the  visual  ordering  of  photographs  according  to  image  quality 
was  also  studied.  Precise  and  approximate  analysis  techniques  of  microdensitometer 
data  for  obtaining  measures  of  photographic  quality  parameters  were  developed  for  black 
sod  white  photography  and  a  brief  investigation  of  the  extension  of  these  techniques  to 
color  images  was  conducted.  Image  quality  parameter  evaluation  techniques  are  docu¬ 
mented  and  some  preliminary  attempts  to  derive  summary  measure  functions  are  discussed. 
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I.  INTRODUCTION 


This  document  is  the  final  report  on  Project  Q-CAR  El.  The  project  was 
conducted  at  the  Cornell  Aeronautical  Laboratory,  Inc.  ,  for  the  Rome  Air 
Development  Center  under  Air  Force  Contract  No.  AF  30(602) -3206.  The  proj¬ 
ect  involved  the  determination  of  an  approximate  summary  measure  of  photo¬ 
graphic  image  quality,  also  the  concern  of  an  earlier  study  conducted  at  CAL 
for  RADC  (Air  Force  Contract  No.  AF  30(602)-2684). 1 

The  objective  of  the  Q-CAR  II  Project  was  to  accomplish  the  following 
tasks: 

1.  The  delineation  and  documentation  of  techniques  for  determining  the 
values  of  parameters  which  are  descriptive  of  photographic  image 
quality.  These  parameters  are  to  be  measured  from  real  imagery 
without  recourse  to  test  charts. 

2.  The  analysis  of  data  from  the  earlier  work  at  CAL1  as  well  as  from 
similar  work  by  others  to  determine  an  approximate  relation  between 
photointerpreter  performance  and  the  image  quality  measures  to  be 
used  as  a  quick  summary  measure. 

3.  The  establishment  of  a  visual  technique  for  obtaining  a  measure  of 
image  quality. 

4.  The  familiarization  of  RADC  personnel  with  image  evaluation  tech¬ 
niques  including  assistance  in  microdensitometer  techniques,  computer 
programming,  and  the  design  and  use  of  spatial  filtering  apparatus. 

The  first  of  the  above  tasks  involves  the  determination  of  four  image 
quality  parameters  (resolution,  contrast,  passband,  and  granularity)  selected 
on  the  basis  of  work  done  on  the  earlier  contract1  as  being  sufficient  to  de¬ 
scribe  the  various  objective  aspects  of  photographic  imagery.  Procedures 
have  been  established  for  determining  these  parameters  from  real  imagery 
without  recourse  to  test  charts.  Precise  and  approximate  methods  of  analyses 
of  microdensitometer  data  have  been  documented  in  Section  II  of  this  report. 
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The  second  and  third  tasks  described  above  were  continuations  of  earlier 
work  done  at  CAL.  *  During  this  previous  program  a  thousand  photographs 
with  a  range  of  quality  parameters  were  generated  and  used  in  interpretation 
tests.  A  correlation  between  photointerpreter  scores  and  the  image  quality 
parameters  was  sought  but  the  low  scores  achieved  by  the  interpreters  pre¬ 
cluded  the  derivation  of  a  meaningful  summary  measure.  During  the  present 
effort  275  of  the  modified  photographs  were  re-examined  by  photoanalysts*  at 
CAL  and  relationships  sought  between  various  functions  of  the  image  quality 
parameters  and  the  photointerpreter  evaluation  of  the  photographs.  A  possible 
trend  (based  upon  visual  inspection  of  a  scattergram)  existed  between  measures 
of  judged  rank  of  photointerpretability  and  a  summary  measure  of  quality 
parameters.  The  modified  photographs  were  also  used  in  tests  involving  the 
determination  of  the  optimum  viewing  magnification  for  each  photograph  which 
was  related  to  judged  interpretability  to  explore  the  optimum  magnification 
technique  as  a  visual  summary  measure.  It  was  found  that  the  visual  ranking 
(unaided  eye)  of  the  photographs  and  the  judged  interpretability  of  the  photo¬ 
graphs  show  greater  correlation  than  does  the  ranking  by  optimum 
magnification. 

The  familiarization  of  RADC  personnel  with  image  evaluation  techniques 
and  with  the  design  and  use  of  spatial  filtering  apparatus  was  a  continuing 
process  terminating  with  this  final  report.  Image  quality  measurement  tech¬ 
niques  as  they  existed  at  the  initiation  of  the  present  contract,  including  the 
use  of  computer  programs,  were  documented  in  a  memorandum  to  RADC.  The 
experience  gained  by  RADC  in  the  use  of  spatial  filtering  techniques  has  been 
documented  by  Peter  Parry  2  (RADC). 

Early  in  the  program  a  study  of  the  extension  of  the  black  and  white  image 
quality  evaluation  techniques  to  color  photography  was  requested  by  RADC.  A 
brief  investigation  of  the  problem  was  conducted  and  the  results  of  this  study 
were  reported  separately  to  RADC. 


Photoanalysts  and  photo  interpreters  are  distinguished  by  a  basic  training  dif¬ 
ference.  A  photo  interpreter  is  trained  by  the  military  and  has  military  ex¬ 
perience  exclusively;  whereas  a  photoanalyst  is  trained  and  experienced  in 
civilian  applications  of  photointerpretation,  although  he  may  also  have  had 
military  training  and  experience. 

2 

Parry,  Peter  D.  Image  Modification  by  Spatial  Filtering  RAW-TM-63-13 
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II.  IMAGE  QUALITY  PARAMETER  EVALUATION  TECHNIQUES 


Any  combination  of  parameters  selected  to  represent  the  quality  of  a 
photographic  image  must  represent  both  the  signal  and  the  noise  portions  oi  the 
image.  For  a  photographic  system  the  signal  can  be  represented  as  the  product 
of  the  contrast  of  the  objects  photographed  and  the  complete  system  transfer 
function  (i.  e. ,  system  contrast  modulation  as  a  function  of  spatial  frequency). 
The  noise  of  a  photographic  system  is  represented  by  the  random  fluctuations 
in  density  due  to  the  granular  structure  of  photographic  emulsions.  For  this 
and  the  previous  study,  four  independent  parameters  were  selected. 

The  signal  is  represented  by  the  contrast  and  by  two  parameters  which  de¬ 
scribe  the  transfer  function.  Resolution  (R)  corresponding  to  the  25%  point  of 
the  transfer  function  describes  the  extent,  and  the  ratio  of  equivalent  pass- 
band  (i.  e. ,  the  area  under  the  square  of  the  transfer  function)  to  the  resolution 
represents  the  shape  of  the  transfer  function. 

While  the  contrast  for  any  specific  target  and  background  can  easily  be  de¬ 
termined  from  a  photograph,  this  value  may  obviously  not  be  representative  of 
all  target  and  background  combinations  in  the  scene  since  a  whole  spectrum  of 
brightness  ratios  can  exist  in  the  real  situation.  Scene  contrast  is  defined 
therefore  as  being  representative  of  the  most  probable  magnitude  of  density 
differences  for  all  target  background  combinations  in  the  scene.  That  is,  a 
high  scene  contrast  value  implies  that  it  is  most  probable  that  any  specific 
target  and  background  will  have  a  large  density  difference  while  a  low  scene 
contrast  value  implies  a  high  probability  that  any  target  background  combina¬ 
tion  in  the  scene  will  have  a  low  density  difference. 

The  film  granularity  (rr)  is  defined  here  as  the  root  mean-square  density 
fluctuation  obtained  when  a  uniformly  exposed  area  of  the  film  is  scanned  with 
a  circular  aperture  of  small  area  (A). 

Techniques  for  determining  the  values  of  resolution,  passband,  and  gran¬ 
ularity  are  described  in  A  below.  Methods  for  determining  approximate  values 
of  these  parameters  are  presented  in  B.  Various  definitions  of  scene  contrast 
are  described  in  C  along  with  the  methods  of  measuring  these  values. 


A.  MEASUREMENT  TECHNIQUES 

The  first  subsection  below  considers  resolution  and  passband  because  both 
are  evaluated  from  the  same  data,  and  the  second  considers  granularity  which 
requires  separate  data. 
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1.  Resolution  and  Passband 


Both  the  resolution  and  passband  are  obtained  from  a  microdensitometer 
scan  across  an  edge  within  the  image  format.  The  following  operations  are 
required: 

(a)  Selection  of  an  edge  for  scanning 

(b)  Selection  of  a  scanning  aperture 

(c)  Scanning  across  the  edge  to  obtain  the  edge  density  function 

(d)  Data  processing  to  provide  resolution  and  passband. 

These  four  operations  are  now  discussed  in  detail. 

(a)  An  edge  selected  for  scanning  must  be  one  that  results  from  an  edge 
in  the  scene  whose  transition  is  expected  to  be  sharp  compared  to  the 
minimum  resolvable  distance  on  the  ground.  Since  the  resolution  of 
the  system  is  not  known,  an  edge  must  be  selected  by  inferring  that 
this  criterion  is  met.  For  present  day  photographic  systems  for  ex¬ 
ample,  (which  achieve  ground  resolution  on  the  order  of  one  foot  at 
best),  the  peak  of  a  roof  on  an  ordinary  house  (which  may  actually  have 
an  edge  width  of  a  few  inches)  provides  a  satisfactory  edge  for  scan¬ 
ning  if  no  perturbing  object  such  as  a  chimney  is  present.  If  the 
system  can  resolve  blades  of  grass,  an  edge  with  a  much  sharper 
transition  (a  painted  line  for  example)  must  be  used.  The  areas  on 
either  side  of  the  edge  transition  should  be  large  compared  to  the  edge 
width  and  uniform  in  brightness  so  that  a  uniform  exposure  in  the 
image  will  result.  The  peak  of  the  roof  of  an  ordinary  house  meets 
this  criteria.  A  quonset  hut,  for  example,  would  not  provide  a  satis¬ 
factory  edge.  Although  it  may  appear  to  have  a  sharp  edge  because  one 
side  is  shadowed,  the  brightness  of  the  areas  on  either  side  of  the  ap¬ 
parent  edge  would  vary  with  distance  from  the  edge.  Because  of  the 
uncertainty  of  the  selection  of  "good'  edges  several  should  be  selected 
and  scanned.  Only  the  edges  yielding  the  higher  resolution  values 
should  be  accepted  as  good  sources  of  the  n  jasures.  *  To  assure  that 
only  the  linear  portion  of  the  H-D  curve  is  utilized,  edges  whose 
limiting  densities  are  (by  visual  inspection)  not  the  limiting  densities 
for  the  scene  should  be  selected. 

_ 

Resolution  varies  with  format  position.  It  has  been  assumed  here  that  edges 
have  been  selected  from  a  limited  region  of  the  format  such  that  the  resolution 
is  essentially  constant. 
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(b)  There  are  two  considerations  for  the  selection  of  the  scanning  aper¬ 
ture.  The  first  is  the  desirability  of  using  a  large  area  in  order  to 
reduce  the  noise  due  to  grain.  The  second  is  the  use  of  a  small 
dimension  in  the  scan  direction  which  prevents  further  spreading  of 
the  edge  by  convolution  with  the  aperture.  This  suggests  that  the 
aperture  be  a  narrow  slit  aligned  parallel  to  the  edge.  The  width 
should  be  such  that  a  change  in  width  does  not  visibly  affect  the  edge 
trace  (other  than  perhaps  a  change  in  noise  level),  but  otherwise 
should  be  as  large  as  possible  to  reduce  noise  due  to  grain. 

There  are  two  factors  thst  will  limit  the  slit  length.  The  first  obvi¬ 
ously  is  the  length  of  the  edge  itself.  The  ends  of  the  slit  should  be 
kept  well  clear  of  the  ends  of  the  edge  in  order  to  assure  that  the 
density  does  not  vary  along  the  edge.  The  second  factor  is  a  practical 
limit  depending  on  the  accuracy  to  which  the  slit  can  be  aligned  with 
the  edge.  Where  cross-hairs  are  provided  for  this  purpose,  the  edge 
can  be  visually  aligned  to  within  approximately  0. 5*  to  1°.  The  edge 
may  be  considered  to  be  improperly  represented  if  it  is  misaligned  to 
the  extent  that  it  is  parallel  to  a  diagonal  of  the  scanning  slit.  The 
alignment  accuracy  of  0. 5°  to  1*  therefore  suggests  an  80:l(cot  0. 75°) 
length  to  width  ratio.  If  the  ratio  of  length  to  width  of  the  slit  exceeds 
80:1,  a  substantial  increase  in  the  effective  width  in  the  scan  direction 
will  result  from  a  small  error  in  the  alignment  angle. 

The  procedure  for  determining  the  proper  slit  is  a  matter  of  trial  and 
error.  A  slit  is  selected  initially  whose  length  is  less  than  the  length 
of  the  edge  (less  than  2/3  the  edge  length).  The  width  is  changed  for 
each  scan  until  the  maximum  width  that  does  not  visibly  affect  the 
shape  of  the  density  trace  is  found.  During  these  scans  the  length  to 
width  ratio  should  not  exceed  80:1  in  order  that  alignment  problems 
do  not  occur. 

Once  the  proper  slit  width  has  been  determined,  the  maximum  length 
should  be  found  (again  by  trial  and  error)  such  that  the  density  trace 
again  remains  unaffected,  other  than  a  change  in  the  noise  fluctuations 
in  the  trace. 

It  should  be  pointed  out  that  the  slit  dimensions  discussed  above  are 
bounds  on  the  dimensions  that  will  provide  low  noise  with  a  minimum 
of  distortion  to  the  desired  edge  function.  In  practice,  the  final  se¬ 
lection  of  slit  dimensions  will  be  limited  by  those  slits  available  for 
scanning.  In  any  event  the  bounds  should  not  be  exceeded. 
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(c)  After  the  proper  slit  has  been  selected  and  aligned,  the  final  scan 
from  which  the  resolution  and  passband  will  be  determined  can  be 
made.  The  scan  should  extend  far  enough  on  either  side  of  the  edge  to 
guarantee  that  the  portion  desired  for  processing  will  be  included.  If 
neighboring  objects  on  either  side  of  the  edge  are  included  in  the  scan, 
it  will  be  easier  to  identify  the  trace  with  the  image  itself,  thus  aiding 
in  the  decision  of  which  portion  is  to  be  used  for  processing. 

(d)  The  measures  of  resolution  and  passband  are  computed  from  the 
density  trace  with  the  aid  of  a  computer.  The  processing  is  accom¬ 
plished  as  follows: 

(1)  Sampling  of  the  density  trace  for  computer  input 

(2)  Sm<  hing  of  input  data  to  reduce  fluctuations  due  to  grain 

(3)  Calculation  of  the  line  spread  function 

(4)  Calculation  of  the  passband 

(5)  Calculation  of  the  transfer  function  from  which  the  resolution  is 
determined. 

With  the  exception  of  Steps  (1)  and  (2),  the  processing  is  routine  and  is  dis¬ 
cussed  in  detail  in  Appendix  n.  The  remainder  of  this  section  will  be  concerned 
with  sampling  and  data  smoothing. 

The  primary  problem  in  providing  a  set  of  data  to  the  computer  for  analysis 
is  the  decision  of  where  on  the  density  trace  to  start  and  end  the  sampled 
section.  If  there  are  no  other  objects  in  the  vicinity  of  the  scanned  edge,  there 
will  be  no  interference  problem  and  the  ends  should  be  selected  where  the 
density  trace  (excluding  noise)  appears  constant  to  the  eye.  If  interfering  ob¬ 
jects  are  present,  it  is  necessary  to  terminate  the  sampling  closer  to  the  edge. 
This  premature  termination  will  give  rise  to  errors  in  the  computed  values  of 
resolution  and  passband.  In  both  a  recently  completed  internal  research  pro¬ 
gram^,  and  the  present  program  (Q-CAR  II),  edges  were  found  whose  density 
traces  possess  long  "tails"  of  finite  slope  (due  to  a  line  spread  function  with  long 
tails).  Such  traces  (indicative  of  a  low  ratio  of  passband  to  resolution)  often 
give  rise  to  errors  due  to  termination. 


3 
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Once  the  terminating  points  have  been  selected,  the  density  trace  within 
these  points  is  sampled  at  approximately  50#  equally  spaced  points.  The  use  of 
less  than  50  points  may  cause  the  shape  of  the  edge  to  be  poorly  represented. 
There  is  certainly  no  disadvantage  to  using  more  than  50  points  except  for  the 
time  spent  in  the  sampling  and  the  preparation  of  the  computer  input  data. 

As  discussed  previously,  the  fluctuation  in  the  density  trace  due  to  film 
grain  is  reduced  by  making  the  scanning  aperture  as  large  as  possible.  The 
aperture  thus  provides  some  smoothing  prior  to  sampling  which  reduces  the 
number  of  samples  required  to  represent  the  function  but  lacks  the  flexibility 
of  numerical  smoothing  techniques.  The  scanning  aperture  often  does  not  re¬ 
duce  the  fluctuation  to  a  level  small  enough  that  Steps  (3),  (4),  and  (5)  can  be 
carried  out  to  provide  satisfactory  values  of  resolution  and  passband.  Ad¬ 
ditional  smoothing  is  required  which  can  be  accomplished  in  two  ways: 

(a)  Hand  Smoothing  -  Prior  to  sampling,  a  smooth  curve  is  drawn  through 
the  noisy  density  trace,  and  the  smoothed  curve  sampled  for  computer 
input.  An  analysis  of  how  well  this  method  extracts  the  signal  from 
the  signal  plus  noise  is  difficult  since  the  smoothing  is  subjective.  It 
has  the  advantage  that  it  provides  a  "quick  look"  at  the  density  trace, 
but  the  disadvantage  that  it  is  often  biased. 

(b)  Numerical  Smoothing  -  The  use  of  a  computer  in  the  natural  course 
of  calculating  the  measures  of  resolution  and  passband  allows,  with 
little  effort,  complex  smoothing  of  the  noisy  density  trace  by  numer¬ 
ical  techniques.  Two  numerical  methods  have  been  utilized  to  provide 
smoothing;  a  least  squares  fit  of  a  polynomial,  and  linear  filtering. 

The  first  smoothing  routine  is  the  least  squares  fitting  of  a  polynomial  to 
the  sampled  density  trace.  The  degree  of  the  polynomial  was  varied  and  a  7th 
degree  was  selected  as  a  compromise  between  poor  fitting  of  lower  degree 
polynomials  and  the  poor  "noise  filtering"  of  polynomials  of  higher  order.  With 
a  fifth  degree  polynomial,  for  example,  it  was  noted  that  in  both  the  high 
gradient  portion  and  at  the  ends  of  the  density  trace,  the  slope  of  the  fitted 
polynomial  deviated  considerably  from  that  of  the  trace.  For  these  reasons, 
the  derivative  of  the  density  trace  and  the  trace  itsell,  were  fitted  with  a  7th 


* 

The  choice  of  50  points  was  made  on  the  assumptions  that  edges  usually  can¬ 
not  be  traced  far  beyond  the  region  of  maximum  transition.  Clearly  in  the 
case  of  test  edges  where  large  constant  regions  are  available  many  more  than 
50  points  would  be  needed  for  adequate  representation. 
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degree  polynomial  with  special  emphasis  on  the  derivatives  of  the  end  points. 
This  leads  to  a  least  square  error*  which  can  be  written  as  the  weighted  sum 
of  three  square  errors.  The  total  error  is  then  minimized  with  respect  to  the 
polynomial  coefficients.  Ihe  use  of  a  polynomial  fitted  in  this  manner  yielded 
a  definite  improvement  over  the  polynomial  fitted  to  the  density  alone. 

A  second  technique  for  data  smoothing  is  linear  numerical  filtering. 4  The 
procedure  is  to  compute  a  smoothed  value  for  each  density  value  in  the  sample 
from  a  linear  combination  of  the  other  sample  points.  This  is  equivalent  to  a 
convolution  of  the  noisy  density  trace  with  a  function  which  is  characteristic  of 
a  low  pass  filter.  In  this  manner  the  high  frequency  fluctuations  are  greatly 
reduced,  while  the  edge  trace  (predominantly  low  frequencies)  undergoes  minor 
distortion.  There  are  two  considerations  in  designing  this  filter;  the  shape  of 
the  function,  and  the  cut-off  frequency.  Preliminary  trials  have  indicated  that 
the  shape  is  of  minor  importance  but  the  cut-off  frequency  should  be  selected 
with  care.  Again,  as  with  the  microdensitometer  scanning  aperture,  too  high 
a  cut-off  frequency  will  not  filter  out  the  noise  and  too  low  a  frequency  will 
excessively  distort  the  signal. 

The  linear  filter  selected  yields  the  following  smoothed  density  values; 


n 


w 

■  .  1  L  lj 

V'  (n-  Ijl  +  1)  j  =  -n 

j  =wi 

where; 

=  raw  density  value  from  trace  at  kth  sample  point 

W 

=  density  value  after  smoothing  at  kth  sample  point 

n 

=  scale  factor 

* 

Appendix  n 
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The  cut-off  frequency  is  controlled  by  the  parameter  n .  As  the  parameter  n 
is  increased,  the  cut-off  frequency  will  become  lower. 

As  an  example  of  the  smoothing,  Figure  1  shows  a  truncated  density  curve 
(corresponding  to  a  gaussian  transfer  function)  including  random  noise.  The 
smoothed  density  curves  for  both  the  fitted  polynomial  and  the  linear  filter 
(i  =  4)  are  included.  The  effectiveness  of  the  7th  degree  polynomial  fitting  and 
linear  numerical  filtering  just  described  were  compared  by  using  each  technique 
to  analyze  a  series  of  edge  traces  derived  for  systems  with  known  transfer 
functions.  Two  density  curves  were  used;  one  corresponding  to  a  gaussian 
transfer  function  and  the  other  to  an  exponential  transfer  function.  The  density 
curves  were  truncated  to  provide  a  reasonable  region  for  sampling  and  each 
was  used  many  times  with  independent  random  noise  samples  added.  The 
values  of  R  and  Ne  obtained  by  using  the  polynomial  and  the  linear  filter  were 
compared  to  the  correct  values  as  determined  under  the  conditions  of  no  noise 
and  no  smoothing.  This  comparison  to  the  true  values*  is  shown  in  Figures  2 
and  3  where  the  results  for  edges  with  high  values  of  noise  and  low  values  of 
noise  are  separated  to  simplify  the  figures.  For  the  cases  considered,  the 
overlapping  of  the  bands  in  these  figures  for  the  polynomial  fitting  and  the 
linear  filtering  techniques  indicate  no  preference  for  one  technique  over  the 
other. 

2.  The  Determination  of  Film  Granularity 

Granularity1  is  a  function  of  the  emulsion  used,  the  developing  process,  the 
average  density  level  and  the  spatial  frequencies  over  which  it  is  measured. 

The  first  two  factors  are  not  involved  in  the  measurement  process  and  therefore 
need  not  be  considered.  The  third  factor  can  be  taken  into  account  most  readily 
by  making  the  granularity  measurement  at  approximately  the  average  image 
density*.  While  the  grain  noise  of  photographs  other  than  originals  can  be  a 
function  of  spatial  frequency,  the  grain  spectrum  of  original  photographs  is 
very  nearly  constant.  In  controlled  experiments,  where  film  is  exposed  using 
a  uniform  light  source,  only  the  grain  spectrum  is  present  in  the  developed 
image.  Continuing  analysis  of  film  granularity  has  shown  that  real  imagery 
frequently  contains  a  small  amount  of  signal  power  even  in  an  apparently  uni¬ 
form  area.  The  effect  of  the  presence  of  this  signal  is  to  increase  the  value  of 


* 

The  "true  values"  are  those  for  the  theoretical  truncated  function,  and  there¬ 
fore  are  not  values  expected  if  the  theoretical  curve  were  continued  to 
infinity  (See  Reference  3) 
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Figure  1.  Smoothed  and  Unsmoothed  Edge  Functions 
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<r  obtained,  especially  for  low  grain  films.  This  is  illustrated  in  Figure  4.  A 
small,  low  frequency  signal  spectrum  (dotted  curve)  is  shown  superimposed  on 
a  flat  grain  spectrum  (solid  line).  Since  a  is  in  a  sense  a  measure  of  the  area 
under  the  composite  curve  (after  multiplication  by  the  scanning  aperture  fre¬ 
quency  response),  the  small  signal  causes  an  increase  in  the  measured  value 
of  a  that  is  dependent  upon  the  ratio  of  noise  to  signal.  The  effect  of  this 
residual  signal  can  be  removed,  however,  by  using  numerical  filtering 
techniques'*  to  weight  the  data  so  that  only  the  contributions  from  spatial 
frequencies  above  Vq  are  included.  The  response  curve  of  this  "filter"  (dotted 
line)  is  also  shown  in  Figure  4.  It  is  clear  from  Figure  4  that  the  numerical 
filtering  technique  removes  a  part  of  the  grain  spectrum  as  well  as  the  residual 
signal  spectrum.  The  value  of  Op  obtained  after  filtering  is  thus  lower  than 
the  true  value  but  is  not  affected  by  the  presence  of  varying  amounts  of  signal. 
The  filtered  value  of  op  can  be  corrected  to  the  true  value  by  multiplying  it 
by  the  theoretical  ratio,  pp ,  of  an  arbitrary  rms  density  fluctuation  expected 
for  an  unfiltered  flat  grain  spectrum  to  that  rms  value  expected  after  filtering 
with  a  specific  filter. 
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Figure  4.  Spectral  Relationships  of  Filtering 
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Granularity  can  thus  be  determined  in  the  following  manner: 

(a)  A  uniformly  exposed  area  whose  density  approximates  the  scene 
average  is  selected  by  visual  inspection. 

(b)  The  selected  area  is  scanned  with  a  microdensitometer  equipped  with 
a  digital  output  device  and  using  a  small  circular  aperture  (a  10  v 
diameter  circle  was  used  at  CAL  for  convenience.  Kodak  uses  a  24  n 
diameter  aperture*). 

(c)  During  the  scan  which  results  in  a  trace  such  as  shown  in  Figure  5, 
the  density  is  sampled  at  a  rate  of  from  1  to  2  samples  per  effective 
aperture  diameter,  converted  to  digital  form  and  punched  on  paper 
tape,  cards,  or  fed  directly  into  a  computer.  Approximately  1000 
points  should  be  taken  in  this  manner.  This  implies  that  a  uniform 
area  in  the  image  must  have  a  dimension  of  at  least  5  to  10  millimeters. 
Where  this  is  not  possible,  a  series  of  scans  can  be  made  across  the 
uniform  area  along  parallel  lines  at  least  one  aperture  diameter  apart. 

(d)  The  average  density  and  the  root  mean-square  density  fluctuation  (o) 
of  all  the  data  points  are  then  determined. 

(e)  All  of  the  data  points  outside  of  2cr  are  then  discarded  to  avoid  the 
inclusion  of  transient  and  unusually  large  fluctuations  in  density  due 
to  scratches  and  dust  spots.  A  new  average  density  is  computed  for 
the  remaining  points. 


*  The  root  mean-square  density  fluctuation,  o  ,  is  related  to  the  area  of  the 
scanning  aperture  by  a-  G  •  A_1/2,  where  G  is  a  constant  for  any  given  film 
called  the  Selwyn  granularity  constant.  The  value  of  a  obtained  with  a  given 
aperture  can  thus  be  related  to  that  for  a  different  aperture  by  cr  j  =  o2  ^2 
where  D  is  the  diameter  of  the  aperture. 
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Figure  5.  Granularity/  Trace 
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(f)  To  eliminate  low  frequency  data  which  may  be  present  due  to  a  small 
residual  image  "signal",  the  remaining  points  are  weighted  using 
numerical  linear  filtering  techniques  and  the  root  mean-square  fluctu¬ 
ation  of  the  weighted  points  (op)  is  computed.  The  actual  value  of  a 
can  then  be  computed  by  multiplying  by  Pp*. 


B.  APPROXIMATE  METHODS 


The  previous  sections  considered  image  quality  parameter  evaluation 
techniques  which  utilize  a  computer  in  the  analysis  of  microdensitometer  scans. 
This  section  concerns  techniques  wherein  simple  geometrical  analyses  of  thri 
same  density  traces  are  used  to  obtain  a  quick,  though  perhaps  less  accurate, 
evaluation  of  the  same  image  quality  parameters. 


1.  Edge  Traces 


The  relationship  between  the  slope  D'(x)  of  a  density  trace  from  the  scan 
of  an  edge  and  the  line  spread  function  of  the  system,  L(x).  presented  in 
Reference  1  and  in  Appendix  n  of  this  report  can  be  approximated3  as: 


L(X)  = 


D'(X) 

AD 


(1) 


♦At  CAL  granularity  was  measured  using  a  10  p  diameter  aperture.  The  density 
was  sampled  every  5.  56  p  by  scanning  at  2  mm/min  and  sampling  360  times  per 
minute.  After  eliminating  the  data  outside  of  the  2  a  point,  the  remaining  points 
were  weighted  in  the  following  manner.  Each  weighted  point  D'^  was  computed 

f  4 

from  the  data  point  using  D'k  =  2  _  J  Wn  °k+n 


where: 

n 

i 

£ 

II 

£ 

-0.  00391 

W-3  = 

w3  = 

-0.  03125 

W-2  = 

W2  = 

-0.  10938 

3 

1 

K-* 

II 

3 

II 

-0.  21875 

II 

o 

£ 

+0.  72657 

For  this  filter  =  30  lines/mm  and  pp  =  1.  23. 
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where  AD  is  the  difference  between  the  upper  and  lower  density  limits  of  the 
edge  trace.  In  Reference  (1)  a  correlation  between  the  maximum  value  of  the 
line  spread  function  and  the  resolution  was  presented  which  resulted  in  the 
empirical  relationship 

L(x)  =  1.45R  (2) 

max 


Equations  (1)  and  (2)  can  be  used  to  obtain  an  approximate  value  of  both  the 
resolution  and  the  passband  to  resolution  ratio  of  a  photographic  system 
directly  from  the  density  trace.  Figure  6  shows  a  typical  density  trace  with 
a  line  drawn  tangent  to  it  at  one  point.  From  Figure  6, 


D’vx) 


AD 

AX 


and  therefore  from  Equation  (1) 


L(X)  = 


1 

AX 


Combining  Equations  (1),  (2)  and  (3)  yields 


R  = 


_ 1_ 

1.45  (AX) 


min 


(3) 


(4) 


The  resolution  of  a  system  can  thus  be  determined  by  drawing  a  tangent 
through  the  point  of  maximum  slope  of  the  edge  trace,  determining  the  distance 
AXmin  *n  millimeters  from  the  scale  of  the  microdensitometer  chart  paper  and 
computing  the  resolution  using  Equation  (4). 

The  passband  of  a  system  is  defined  to  be  the  area  under  the  square  of  the 
line  spread  function*.  Thus,  for  a  given  resolution  the  passband  and  hence  the 
passband  to  resolution  ratio  decrease  as  the  line  spread  function  becomes  wider 
at  low  values  of  L(x)  and  correspondingly  narrower  at  high  values  of  L(x)  since 
the  area  under  L(x)  is  defined  to  be  unity  (i.  e. ,  as  the  energy  becomes  spread 
over  a  greater  distance).  From  Equation  (1)  it  can  be  seen  that  this  "spreading" 
of  L(x)  implies  that  as  passband  decreases,  the  density  trace  of  an  edge  also 
tends  to  "spread"  as  indicated  by  the  dashed  line  in  Figure  6.  This  effect 
suggests  two  possible  means  of  approximating  the  passband  to  resolution  ratio 
from  simple  geometric  considerations. 
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Figure  6.  Construction  for  Determining  Line  Spread 
Function  from  an  Edge  Trace 

Consider  the  area  bounded  by  the  edge  trace,  the  lines  of  minimum  and 
maximum  density,  and  a  tangent  drawn  through  the  point  of  maximum  slope  of 
the  edge  trace.  This  area,  a,  is  illustrated  in  Figure  7  and  it  should  increase 
with  a  decrease  in  passband,  a  decrease  in  resolution  and  an  increase  in  AD. 

It  is  plausible  that  one  method  of  estimating  the  passband  to  resolution  ratio  of 
a  system  could  be  based  on  a  relationship  between  Ne/R  and  a. 

A  series  of  edge  traces  for  which  the  passband  to  resolution  ratio  was 
known  were  used  to  evaluate  the  feasibility  of  using  this  method  to  predict 
Ne/R.  The  areas  were  approximated  as  triangles,  their  area  (in  density  units- 
millimeters)  determined,  and  a  quantity  a'  computed  (normalized  to  the  AD 
and  R  values)  as: 


*  _  a  (Density -millimeters)  •  R  (millimeters  *)  (5) 

a  AD  (density) 

The  values  of  a'  obtained  from  several  real  and  several  theoretical  edge  traces 
were  plotted  as  a  function  of  their  passband  to  resolution  ratio  (Figure  8). 

.tl though  the  points  are  scattered,  a  definite  trend  exists.  That  is,  larger 
values  of  a'  are  obtained  for  low  Ne/R  edges  than  for  high  Ne/R  edges.  The 
technique  described  above  can  thus  be  used  to  obtain  a  value  for  a' ,  and  a 
value  of  passband  to  resolution  ratio  can  be  estimate.-  .rom  the  line  in  Figure  8. 
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Figure  7.  Geometric  Construction  for  the  Area  Method 
of  Obtaining  Passband  to  Resolution  Ratio 

The  second  suggested  method  relates  a  measure  of  the  rate  of  change  of 
the  width  of  the  line  spread  function  at  low  values  of  L(x)  to  the  passband  to 
resolution  ratio.  Several  measures  of  the  width  of  the  line  spread  function  at 
various  fractions  of  L(x)max  were  tested  and  the  ratio  of  the  width  of  L(x)at 
1/8  L(x)max  to  the  width  of  L(x)max  was  found  to  provide  the  best  correlation 
with  Ne/R.  As  implied  by  Equations  (1)  and  (3)  this  ratio  can  be  obtained 
directly  from  the  density  trace  by  locating  the  points  along  the  trace  at  which 
the  slope  is  1/8  and  1/4  of  the  maximum  slope,  as  illustrated  in  Figure  9,  and 
measuring  distances  Ax and  AXj/g.  A  plot  of  the  ratios  of  AXjyg  to 
AX1/4  determined  for  the  same  traces  mentioned  above,  is  shown  as  a  function 
of  Ne/R  in  Figure  10.  Again,  despite  the  scatter,  it  can  be  inferred  from  this 
figure  that  a  definite  trend  exists  and  that  therefore  Ne/R  can  be  estimated 
using  the  technique  described  above  to  compute  the  ratio  AXjyg  to  AX1/4  and 
by  then  referring  to  the  line  in  Figure  10. 

Since  a  considerable  amount  of  spread  exists  in  the  determination  of  Ne/R 
by  either  proposed  methods,  the  estimate  of  Ne/R  should  probably  be  obtained 
by  using  both  methods  and  averaging  the  results. 
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legend: 

O  CALCULATIONS  FOR  THEORETICAL  FUNCTIONS 

X  MEASUREMENTS  FOR  IMAGES  CONSISTING  OF  A 
SINGLE  EDGE.Ne/R  PREDICTED  FROM  IMAGE 
MODIFICATION  PROCESS  (THEORETICAL  AND 
FILTERED  EDGES  TRUNCATED  WITH  TOTAL 


(RESIDUAL  AREA)  (RESOLUTION) 
DENSITY  DIFFERENCE 


Figure  8.  Correlation  of  Passband  to  Resolution  Ratio  with 
a  Function  of  Residual  Area 


2.  Granularity  Traces 

A  method  for  estimating  the  rms  density  fluctuations  obtained  when  a  scan 
across  a  uniformly  dense  area  of  a  photograph  is  made  as  described  in  Section 
n  A  2  has  been  devised  and  is  explained  here. 

While  direct  examination  of  a  trace  such  as  that  shown  in  Figure  5  does 
convey  the  impression  of  these  density  fluctuations,  the  observer's  impression 
of  the  fluctuations  is  strongly  affected  by  the  peak  to  peak  density  differences. 
The  directional  image  smearing  properties  of  a  cylindrical  lens  can  be  used  to 
determine  the  rms  density  fluctuations  in  the  following  manner. 
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Figure  9.  Geometric  Construction  for  the  Gradient  Method  of  Obtaining 

Passband  to  Resolution  Ratio 

The  trace  is  viewed  through  a  cylindrical  lens  which  has  its  "smearing 
axis"  as  shown  in  Figure  11  perpendicular  to  the  density  scale. 

The  lens  should  be  held  at  a  distance  from  the  trace  of  approximately  10 
times  the  focal  length  or  more  and  the  eye  should  be  placed  at  a  distance  from 
the  lens  about  equal  to  the  focal  length.  The  trace  will  appear  "smeared"  (in 
the  direction  of  the  scan)  into  a  band  as  shown  in  Figure  12.  The  width  (in 
density  units)  of  the  dense  area  of  this  band  is  determined  from  the  density 
scale  of  the  chart  paper.  *  A  series  of  tests  conducted  using  a  variety  of  grain 
traces  has  shown  that  the  width  of  this  band  is  approximately  equal  to  2  a  where 
a  is  the  rms  density  fluctuation  as  defined  in  Section  II  A  2  of  this  report. 


*  Lines  of  constant  density  will  be  parallel  to  the  smearing  axis  of  the  lens  and 
thus  will  not  appear  to  be  smeared  as  is  illustrated  in  Figure  12. 
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LEGEND: 


O  CALCULATIONS  FOR  THEORETICAL  FUNCTIONS 

X  MEASUREMENTS  FOR  IMAGES  CONSISTING  OF  A 
SINGLE  EDGE,  Ne/R  PREDICTED  FROM  IMAGE 
MODIFICATION  PROCESS 


RATIO  OF  Ml  PTH  BETWEEN  |/G  SLOPE  POINTS 
WIDTH  BETWEEN  1/4  SLOPE  POINTS 


Figure  10.  Correlation  of  Passband  to  Resolution  Ratio  with 
Rate  of  Change  of  Edge  Trace  Gradient 


C.  THE  DETERMINATION  OF  SCENE  CONTRAST 

As  discussed  earlier  the  value  of  contrast  necessary  for  use  as  a  quality 
parameter  for  aerial  photographs  must  be  representative  of  the  entire  scene. 

In  the  earlier  study*,  scene  contrast  was  the  average  of  the  six  largest  mono¬ 
tonic  density  differences  occurring  in  a  single  microdensitometer  trace  across 
the  image  format  through  a  representative  portion  of  the  photograph.  This 
definition  yields  a  value  of  scene  contrast  which  is  dependent  not  only  upon  the 
contrast  rendition  of  the  photographic  system  (atmosphere  included)  but  also 
upon  the  density  fluctuations  due  to  specific  objects  in  the  image.  Hence,  the 
value  of  scene  contrast  obtained  in  this  manner  is  useful  for  comparing 
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Figure  11.  Illustration  of  Cylindrical  Lens 

scenes  with  the  same  general  class  of  targets.  That  is,  tactical  areas  might 
not  be  expected  to  yield  the  same  results  as  a  highly  detailed  area  such  as  an 
airport  because  the  inherent  contrast  of  nearby  objects  in  each  of  these  scenes 
can  be  quite  different. 

A  brief  analysis  of  the  repeatability  of  this  type  of  measurement  was  con¬ 
ducted  during  the  previous  image  evaluation  study*.  A  ±15%  probable  error 
was  found.  During  the  present  program  a  more  thorough  analysis  disclosed 
that  differences  as  large  as  50%  can  occur  quite  frequently  and  that  the  probable 
error  for  a  single  scan  sample  is  ±30%.  This  analysis  has  shown  that  by  using 
the  data  from  at  least  5  scans  across  the  entire  photograph  a  value  of  scene 
contrast  repeatable  to  ±15%  can  be  obtained.  Since  many  more  than  5  scans 
are  required  to  significantly  reduce  this  error,  scene  contrast  should  be 
measured  in  future  programs  by  using  5  scans  across  the  photograph.  The 
effect  on  the  repeatability  of  the  contrast  measure  of  including  the  density 
differences  from  a  larger  number  of  scans  is  illustrated  in  Figure  13  where 
the  scene  contrast  value  (with  the  standard  deviation  in  the  value)  is  shown  as 
a  function  of  the  number  of  scans  used  to  obtain  the  six  highest  peaks. 
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Figure  12.  "Smearing"  of  Grain  Trace  by  Cylindrical  Lens 
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Figure  13.  Contrast  as  a  Function  of  Number  of  Scans 


The  measurement  of  this  scene  contrast  value  is  accomplished  in  the 
following  manner: 

1.  Five  non-coincident  scans  not  possessing  a  common  intersection  are 
made  across  the  entire  format  through  representative  portions  of  the 
photograph  using  a  circular  aperture  with  an  effective  diameter  of  the 
order  of  2/R  (where  R  is  the  resolution  as  defined  earlier).  The  use 
of  an  aperture  of  this  diameter  results  in  a  value  of  contrast  which 
when  used  with  the  transfer  function  determined  as  in  Section  II  A  l 
above  tends  to  compensate  the  errors  involved  'n  terminating  an  edge 
trace.  This  occurs  since  for  a  given  resolution  low  values  of  Ne/h 
are  obtained  for  systems  which  more  sharply  attenuate  low  spatial  fre¬ 
quencies  than  do  systems  with  high  Ne/R  values.  These  low  spatial 
frequencies  account  for  density  changes  over  areas  in  the  image  large 
enough  that  the  eye  does  not  detect  the  gradient  in  density  which  exists 
far  beyond  the  region  of  maximum  density  change  across  an  edge.  The 
eye  interprets  the  region  of  low  density  gradient  as  constant  density 
regions  thus  receiving  the  impression  of  lower  contrast.  This  is  il¬ 
lustrated  in  Figure  14  where  two  hypothetical  density  traces  across  an 
edge  are  shown.  One  is  that  expected  from  a  system  for  which  a  high 
value  of  Ne/R  would  be  obtained  and  the  other  for  a  system  for  which 
a  low  value  of  Ne/R  would  be  obtained. 


Figure  14.  Apparent  Density  Differences  For  High  and  Low  Passband 

To  Resolution  Ratios 
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DENSITY 


By  using  an  aperture  of  diameter  2/R  for  the  measurement  of  scene 
contrast,  spatial  frequencies  below  about  R/2  contribute  significantly 
to  the  density  fluctuations  obtained  from  the  scan  of  a  photograph. 

2.  The  six  largest  monotonic  density  differences  in  each  trace  are  meas¬ 
ured  as  indicated  in  Figure  15.  The  six  largest  density  differences 
from  the  set  of  30  obtained  in  the  above  manner  are  determined  and 
their  average  computed. 

An  alternative  value  of  scene  contrast  is  one  that  is  descriptive  of  only  the 
contrast  rendition  of  the  system  and  is  independent  of  the  brightness  fluctua¬ 
tions  due  to  specific  objects  in  the  scene.  This  value  of  scene  contrast  could 
be  multiplied  by  the  inherent  contrast  of  specific  targets  and  their  backgrounds 
to  provide  a  value  of  contrast  in  any  scene  for  a  very  specific  task.  The  de¬ 
termination  of  the  alternative  definition  of  scene  contrast  has  been  investigated 
only  to  a  limited  extent.  The  measurement  is  based  on  the  fact  that  large  uni¬ 
form  areas  occurring  in  a  photograph  are  due  to  a  variety  of  natural  and  man¬ 
made  objects,  such  as  for  meadows,  plowed  fields,  bodies  of  water  and  large 
concrete  or  asphalt  areas.  Since  the  reflectances  of  areas  such  as  these  are 
known  the  inherent  contrast  between  any  two  of  them  can  be  computed.  If  a 
variety  of  most  of  the  types  of  terrain,  vegetation,  and  man-made  objects  which 
result  in  large  uniformly  exposed  areas  in  an  aerial  photograph  are  considered 
and  the  average  inherent  contrast  between  all  possible  pairs  of  areas  are  com¬ 
puted,  a  constant  value  of  average  inherent  contrast  is  derived.  A  number  of 
aerial  photographs  of  both  rural  and  urban  areas  were  examined  and  the 


Figure  15.  Typical  Contrast  Trace 
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reflectances  of  large  areas  in  the  scenes  were  postulated  from  a  knowledge 
(determined  by  photointerpretation)  of  the  type  of  terrain  or  vegetation  causing 
the  uniform  exposure.  These  reflectance  values  were  then  used  to  compute  the 
average  contrast  modulation  by  considering  all  possible  pairings  of  areas  with¬ 
out  regard  to  adjacency,  hi  all  of  the  limited  number  of  cases  for  which  the 
average  contrast  modulation  was  computed  (using  as  few  as  5  sample  areas) 
the  value  obtained  was  within  10%  of  that  calculated  using  all  available  reflec¬ 
tance  data  for  a  large  variety  of  terrains.  This  suggests  that  a  determination 
of  the  density  of  several  of  the  larger  uniform  areas  in  a  photograph  is  all  that 
is  required  to  obtain  data  from  which  the  scene  contrast  rendition  can  be  calcu¬ 
lated.  To  test  this  scheme,  several  large  uniform  unidentified  areas  were 
scanned  on  3  photographs  for  which  the  contrast  reduction  factor  (i.  e. ,  the 
apparent  contrast  to  inherent  contrast  ratio)  was  known.  The  relative  exposure 
for  each  of  the  areas  was  determined  from  the  H  and  D  curves  for  the  film  and 
the  average  contrast  modulation  was  computed.  The  ratio  of  this  average  con¬ 
trast  modulation  to  the  "constant?'  value  described  above  was  within  10%  of  the 
known  ratio  of  apparent  to  inherent  contrast  of  the  photographs. 

Further  testing  of  this  technique  for  determining  the  scene  contrast  must 
be  conducted  to  determine  its  limitations  and  reliability. 
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III.  SUMMARY  MEASURES 


The  image  quality  parameters  described  in  the  previous  section  of  this 
report  each  represent  one  facet  of  the  total  quality  of  a  photographic  image. 
This  section  describes  the  relationships  found  between  measures  of  judged  tar¬ 
get  interpretability  and  functional  combinations  (summary  measures)  of  the 
quality  parameters. 

A  visual  estimation  technique  for  determining  an  approximate  summary 
measure  of  image  quality  is  also  discussed. 


A.  RE-EVALUATION  OF  Q-CAR  TEST  PHOTOGRAPHS 

During  the  previous  image  evaluation  study  conducted  at  CAL,  1000  modi¬ 
fied  aerial  photographs  were  produced.  *  These  1000  photographs  consisted  of 
twenty-five  versions  of  each  of  forty  different  aerial  scenes,  with  each  version 
having  different  image  quality  parameter  values.  Ten  representative  targets 
were  selected  in  each  of  the  forty  scenes  and  the  modified  photographs  were 
then  used  in  photointerpretation  tests.  In  current  program,  eleven  of  the  scenes 
(275  photographs)  were  selected  at  random  and  evaluated  by  the  CAL  photo¬ 
interpreters  who  initially  selected  the  10  targets  in  each  scene.  No  actual 
validation  of  those  judgements  based  on  ground  truth  was  attempted.  However, 
only  those  targets  whose  identification  was  independently  agreed  upon  by  three 
photoanalysts  were  used  in  the  experiments.  Their  evaluation  procedure  was 
to  examine  each  of  the  ten  targets  in  each  photograph  and  make  one  of  the  fol¬ 
lowing  judgments: 

1.  if  there  was  no  doubt  that  the  test  question  could  be  answered; 

2.  if  there  was  a  high  probability  that  the  question  could  be  answered; 

3.  if  there  was  a  low  probability  that  the  question  could  be  answered; 

4.  if  there  was  no  doubt  that  the  question  could  not  be  answered. 

The  photographs  were  scored  by  assigning  to  each  of  the  10  targets  in  the 
scene  a  value  of  3,  2,  1,  or  0,  corresponding  to  evaluations  1,  2,  3,  and  4 
mentioned  above.  The  values  from  the  10  targets  in  each  photograph  were 
summed  and  a  percentage  score  was  determined  for  each  of  the  photographs. 
This  percentage  score  (%  score)  is  the  score  referred  to  in  the  remainder  of 
this  section.  * 

♦The  scores  are  tabulated  in  Appendix  I. 
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B.  CORRELATION  OF  INTERPRETABILITY  SCORES  AND  IMAGE  QUALITY 
PARAMETERS 


The  %  scores  obtained  for  the  275  photographs  were  correlated  with  sev¬ 
eral  functions  of  the  image  quality  parameters  which  were  considered  as  pos¬ 
sible  approximate  summary  measures  of  image  quality.  The  following  sum¬ 
mary  measure  functions: 


CR 

a 


CNe 

or 


* 

and 


Ct(Rs) 
S3  =  "kWA 


(A  =  area  of  scanning  aperture  used  to  determine  a  and  Rg  is  the  Selwyn 
resolution  and  r  (Rg)  is  the  value  of  the  system  trans  er  function  at  a  spatial 
frequency  of  Rg. ) 

All  generally  involve  the  signal-to-noise  ratio  k,  since  (as  mentioned  in  the 
introduction  to  Section  II)  contrast,  resolution  and  passband  are  related  to  the 
signal  and  the  granularity  represents  the  noise.  The  first  two  measures, 
and  S2«  are  the  simplest  to  evaluate  once  the  quality  parameters  have  been  de 
termined.  In  this  report  the  image  quality  parameter  values  determined  for 
these  photographs  during  the  previous  study  are  used. 


The  relationship  between  Sj  and  the  %  scores  is  illustrated  in  Figure  16. 
The  probable  error  in  Sj  resulting  from  the  ±30%  probable  error  in  the  values 
of  C  determined  from  the  6  highest  monotonic  density  differences  occurring  in 
one  scan  across  the  scene  (see  Section  n  C)  have  also  been  indicated  in  Figure 
16.  The  errors  in  the  values  of  the  other  parameters  are  not  known  but  are 
not  expected  to  be  of  comparable  size. 


*Sg  is  equivalent  in  form  to  Selwyn' s  equation  (Reference  5)  for  the  sine  wave 
resolution  of  a  photographic  system  but  with  film  "gamma"  and  sine  wave  test 
chart  contrast  modulation  replaced  by  the  scene  contrast  modulation  de¬ 
fined  as  where  C  is  the  monotonic  density  difference  scene 

(Antilog  C)  +1  3 

contrast  defined  in  Section  n  C  of  this  report. 
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Figure  16,  Correlation  Of  Summary  Measure  with  Percent  Score 


A  possible  relationship  (based  on  visual  inspection  of  the  data)  between 
and  the  judged  interpretability  scores  can  be  inferred  from  Figure  16.  Addi¬ 
tional  research  is  required  to  establish  its  reliability  and  to  demonstrate  that 
judged  interpretability  scores  are  predictive  of  direct  measures  of  information 
extraction  performance.  Unless  the  latter  type  of  correspondence  can  be 
shown,  the  validity  of  summary  measures  derived  from  the  data  like  those  of 
Figure  16  would  remain  an  open  question.  In  addition  to  the  validation  of  a 
summary  measure  of  image  quality  against  one  type  of  performance  measure, 
it  also  needs  to  be  tested  against  a  variety  of  performance  indices  (representa¬ 
tive  of  different  interpretation  tasks).  By  this  means,  the  possible  task- 
dependency  of  such  a  measure  can  be  determined  (i.  e. ,  different  summary 
measures  might  be  assigned  to  photography  as  a  function  of  type  and  level  of 
interpreter  tasks). 

Although  inspection  of  a  scattergram  suggests  some  correspondence  be¬ 
tween  the  summary  measure  £>2  and  percent  score,  considerably  more  scatter 
was  apparent  than  in  the  -percent  score  relationship.  While  S2  incorporates 
all  four  of  the  image  quality  parameters  described  in  Section  II  of  this  report 
and  in  Reference  1,  a  certain  degree  of  redundancy  exists  in  the  use  of  both  the 
values  C  (as  determined  from  monotonic  density  differences)  and  Ne/R. 

As  explained  in  Section  DC,  the  effect  of  Ne/R,  which  is  descriptive  of  the 
shape  of  the  system  transfer  function,  is  partially  absorbed  in  the  contrast 
measure.  The  effect  of  system  passband  is  thus  actually  partially  accounted 
for  in  the  definition  of  S^.  The  alternative  definition  of  scene  contrast  pre¬ 
sented  in  Section  II  C  would  not  incorporate  the  effect  of  the  passband  to  resolu¬ 
tion  ratio  since  it  is  a  measure  of  the  zero  frequency  contrast  and  is  not  at- 
fected  by  behavior  of  the  transfer  function  at  low,  non-zero  spatial  frequencies. 
With  regard  to  the  effect  of  low  spatial  frequencies  on  the  photo-interpreter, 
the  value  of  S2  with  this  alternative  definition  of  scene  contrast  thus  should 
prove  to  be  equivalent  to  the  value  of  S} . 

The  determination  of  the  summary  measure  S3  involves  the  solution  of  a 
transcendental  equation.  This  summary  measure  was  computed  for  the  photo¬ 
graphs  of  only  a  few  scenes  but  no  apparent  relationship  was  discernible  with 
percent  score.  For  these  reasons  no  further  study  of  this  quantity  was 
conducted. 


C.  VISUAL  SUMMARY  MEASURE 

A  study  was  conducted  to  establish  a  technique  for  visually  estimating  the 
quality  of  photographs.  In  general,  higher  magnifications  are  used  to  examine 
photographs  with  high  resolution  and  contrast  and  low  granularity  than  for 
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photographs  with  low  resolution  and  contrast  and  high  granularity.  The  de¬ 
termination  of  the  optimum  magnification  of  a  given  photograph  may  therefore 
provide  an  approximate  measure  of  the  total  image  quality.  The  concept  of 
"optimum"  magnification  for  real  imagery*,  however,  is  not  easily  defined  and 
can  vary  with  the  observer.  The  establishment  of  a  visual  summary  measure 
based  on  this  concept  would  therefore  be  dependent  upon  a  specifiable  type  of 
performance  which  defines  "optimum"  magnification  for  real  imagery. 

To  determine  such  a  criterion,  a  series  of  tests  was  performed  in  which  a 
number  of  observers  viewed  25  modified  photographs  of  a  given  scene  using  a 
zoom  microscope.  Each  was  told  to  record  the  "optimum"  magnification  for 
each  photograph  without  being  told  what  was  meant  by  "optimum".  The  criterion 
used  by  each  observer  was  recorded  and  the  values  of  magnification  obtained 
were  plotted  as  a  function  of  the  percent  interpretability  scores  for  each  of  the 
photographs.  Three  examples  of  the  results  obtained  from  these  tests  are 
shown  in  Figure  17  along  with  the  observer's  description  of  the  criterion  used 
to  select  the  magnification.  Although  considerable  variability  between  different 
observers  is  apparent  from  Figure  17,  some  relationship  between  magnifica¬ 
tion  and  photointerpreter  performance  is  indicated. 

Perhaps  the  most  promising  criterion  which  yielded  the  magnifications 
displayed  in  the  lower  scattergram  of  Figure  17  was  viewing  an  edge  (see 
Section  II)  in  the  photograph  and  increasing  the  magnification  until  the  edge 
appears  spread  because  of  the  resolution  or  discontinuous  because  of  the  grain 
structure  of  the  film. 

An  observer  not  involved  in  the  first  test  series  was  instructed  to  perform 
according  to  this  criterion.  The  results  obtained  by  this  trainee,  for  two  dif¬ 
ferent  scenes,  are  compared  to  the  instructor's  results  in  Figure  18.  A  dif¬ 
ference  in  the  minimum  and  maximum  magnification  used  by  the  trainee  and  the 
instructor  is  shown  in  Figure  18.  The  difference  in  absolute  magnification  ob¬ 
tained  by  two  persons  attempting  to  use  the  same  criterion,  the  differences  in 
absolute  magnification  obtained  by  a  single  observer  on  subsequent  trials  with 
the  same  scene,  and  the  scatter  in  the  measurement  of  the  magnification  for 
any  single  scene  indicates  that  the  absolute  magnification  values  do  not  provide 
a  repeatable  measure  which  could  be  correlated  with  the  judged  interpretability 
of  the  test  photographs.  The  optimum  magnification  technique  did  appear  to 
provide  some  rank  ordering  of  the  photographs  for  each  scene  according  to 
judged  interpretability,  which  was  independent  of  the  absolute  level  of  the 


♦When  viewing  resolution  test  charts,  the  optimum  magnification  is  that  which 
enables  the  observer  to  just  distinguish  the  last  resolved  set  of  lines  or  bars, 
i.  e.  when  additional  magnification  does  not  enable  any  smaller  pattern  to  be 
distinguished. 
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PI  SCORE,  %  PI  SCORE,  %  PI  SCORE 


SCERE  1 


MAORI  FI  CAT I OR 


OBSERVER  I 

CRITERION:  hagni ficatior 
FOR  APPEARANCE  OF  GRAIR 
STRUCTURE  IN  SMALL  SCALE  . 
OBJECTS  (RAILROAD  BOXCARS). 


OBSERVER  2 

CRITERION:  MAGNIFICATION  AT 
WHICH  ROW  OF  SMALL  0IJECT8 
(CARS  IN  PARKING  LOT)  COULt 
IE  DISTINGUISHED  WITHOUT 
EXCESSIVE  DEGRADATION  DUE 
TO  GRAIN  OR  SYSTEM  POINT 
SPREAD 


0  N  8  12  16 

MAGNIFICATION 


OBSERVER  3 

CRITERION:  MAGNIFICATION  AT 
WHICH  AN  EDGE  IN  THE  PHOTO¬ 
GRAPH  JUST  BEGINS  TO  LOSE 
THE  APPEARANCE  OF  SHARPNESS. 


Figure  17.  Optimum  Magnification  as  A  Function  of  Photointerpreter 
Performance  for  Different  Observers  and  Criteria 
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Figure  18.  Comparison  of  Magnifications  Obtained  by  Two  Observers 

Using  the  Same  Criterion 


magnifications  used  by  differant  observers.  Rank  order  correlation  coefficients 
between  the  ordering  provided  by  the  magnification  values  obtained  by  3  ob¬ 
servers  for  three  different  scenes,  and  the  judged  interpretability  score  order¬ 
ing  were  computed  and  are  presented  in  Table  1.  A  control  experiment  was 
conducted  in  which  the  sets  of  photographs  ordered  using  the  optimum  magnifi¬ 
cation  technique  were  again  ordered  without  the  aid  of  any  magnification.  The 
control  experiment  indicated  that  an  observer  (not  necessarily  a  photoanalyst) 
can  order  a  set  of  photographs  without  the  aid  of  any  magnification  by  merely 
comparing  one  photograph  to  another  and  deciding  which  appears  to  be  a  better 
photograph.  The  average  rank  order  correlations  with  judged  interpretability 
obtained  by  two  observers  using  the  unrtded  visual  ordering  technique  are  pre¬ 
sented  in  Table  1  for  three  of  the  sets  of  photographs. 

The  data  in  Table  1  show  that  a  set  of  photographs  can  be  ordered  according 
to  judged  interpretability  by  an  observer  using  the  unaided  eye.  The  unaided 
visual  ordering  can  be  seen  to  be  as  good  as,  and  in  one  case,  significantly 
better  than  that  obtained  using  the  optimum  magnification  technique  for  the  sets 
of  photographs  used. 

Photographs  with  much  higher  resolutions  than  those  of  the  test  photo¬ 
graphs  used  ir.  this  study  can  probably  not  be  ordered  as  well  by  the  unaided 
eye  as  they  could  be  by  using  the  optimum  magnification  criteria  since  the  un¬ 
aided  eye  does  not  resolve  detail  much  above  10  lines  per  millimeter.  Even 
in  this  case,  however,  the  photographs  could  be  compared  by  viewing  each  with 
a  fixed  magnification. 


TABLE  1 

RANK  ORDER  CORRELATIONS 


Optimum 

Unaided 

Magnification 

Eye 

Scene  4 

.70 

.86 

7 

.89 

.  82 

18 

.14 

.83 
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INSTRUCTOR 

MAGNIFICATION 


SCENE  7 


MAGNIFICATION 

TRAINEE 

Figure  19.  Correlation  of  Magnifications  Obtained  By  Two 
Observers  Using  the  Same  Criterion 
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IV.  CONCLUSIONS  AND  RECOMMENDATIONS 


As  a  result  of  the  present  effort,  it  is  concluded  that: 

1.  Although  a  suggested  relationship  exists  between  quality  parameters 
and  measures  of  judged  interpretability  of  aerial  photographs,  both  the 
reliability  and  validity  of  this  kind  of  relationship  need  to  be  further 
established. 

2.  The  results  of  the  visual  summary  measure  experiments  indicate  that 
a  rapid  technique  for  ordering  photographs  in  a  set  according  to  their 
judged  interpretability,  consists  of  visually  comparing  each  photograph 
to  the  others  in  the  set.  For  the  cases  tested,  the  "optimum  magnifi¬ 
cation"  technique,  which  requires  more  time  than  does  the  unaided  eye 
technique,  did  not  provide  an  absolute  rating  corresponding  to  judged 
interpretability  and  provided  a  rank  ordering  which  is  no  better  than 
the  unaided  eye  technique. 

3.  A  rapid,  though  less  accurate,  visual  estimation  technique  for  ap¬ 
proximating  image  quality  for  in-field  use  by  unskilled  personnel  has 
been  developed.  The  method  is  limited  to  providing  a  gross  ordering 
of  a  set  of  photographs  according  to  image  quality. 

It  is  recommended  that  future  efforts  in  the  field  of  image  quality  assess¬ 
ment  be  oriented  toward: 

1.  Further  refinement  of  the  data  processing  techniques  used  in  the  de¬ 
termination  of  the  image  quality  parameters.  Specifically  in  the  area 
of  optimizing  numerical  smoothing  techniques  used  with  edge  density 
traces  to  reduce  the  effect  of  noise,  and  in  the  establishment  and  test¬ 
ing  of  more  rigorous  definitions  of  scene  contrast. 

2.  Establishing  the  image  quality  necessary  for  satisfactory  photointerpre¬ 
ter  performance  of  a  variety  of  tasks,  such  as  a  search  task  and  identi¬ 
fication  tasks  involving  specific  target  classes. 

3.  Study  of  special  problems,  such  as  asymmetric  degradations  (i.  e.  , 
image  motion)  and  color  imagery. 
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APPENDIX  I 


The  values  of  the  percentage  scores  for  275  test  photographs  re-evaluated 
as  described  in  Section  III  are  presented  below.  The  nomenclature  of  the  photo¬ 
graphs  is  identical  to  that  in  Reference  1.  The  score  shown  for  each  photo¬ 
graph  is  the  value  agreed  upon  by  the  two  photointerpreters  who  condi  cted  the 
re-evaluation. 


SCENE  4 

SCENE  5 

SCENE  7 

SCENE  12 

P.  I.  * 

% 

P.  I. 

% 

P.  I. 

% 

P.  I. 

% 

19 

93 

24 

100 

19 

97 

25 

87 

5 
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25 
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67 
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67 

18 

63 
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53 

4 

88 

6 

67 

2 

60 

4 

47 

6 

88 

19 

67 

5 

57 

6 

47 

16 

88 

5 

53 

7 

40 

10 

43 
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88 

47 

13 

40 

8 

40 

2 

80 

13 

43 

40 

12 

40 

17 

80 

1 

4 

37 

16 

40 

7 

73 

14 

33 

13 

37 

8 

67 

11 

33 

9 

27 

1 

33 

60 

14 

33 

17 

20 

14 

27 

12 

50 

21 

30 

22 

20 

2 

23 

14 

50 

2 

27 

1 

17 

23 

23 

23 

43 

15 

27 

15 

17 

15 

10 

1 

37 

» 

23 

21 

10 

24 

10 

20 

37 

23 

16 

7 

3 

7 

3 

33 

24 

3 

19 

7 

13 

27 

8 

0 

21 

0 

* 

These  numbers  refer  to  the  photo  interpreter  assignments  in  Reference  1. 
They  are  used  here  to  retain  the  same  identification  number  for  each 
photograph. 
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APPENDIX  II 


DETERMINATION  OF  LINE  SPREAD  AND  TRANSFER  FUNCTIONS 
FROM  AERIAL  PHOTOGRAPHS  -  COMPUTER  IMPLEMENTATION 


This  appendix  describes  the  calculation  of  the  line  spread  and  transfer 
functions  of  an  optical  system  (including  the  film)  utilizing  the  density  trace  of 
an  edge  occurring  in  the  film  format. 

At  CAL  a  program  for  an  IBM  704  computer  has  been  completed  and  is 
capable  of  calculating  the  line  spread  function,  passband,  and  transfer  function 
from  edge  trace  data.  The  program  is  constructed  with  the  calculations  of  the 
line  spread  and  transfer  function  as  subroutines  in  order  that  they  may  be  used 
separately,  if  desired.  The  equations  could  readily  be  programmed  for  any 
other  computer. 


PROGRAM  SUMMARY 

The  input  consists  of  a  data  set  which  is  a  sampling  of  the  curve: 

D  =  D(x) 
where: 

D  is  "density1' 

D(x)  is  the  "edge  trace  function" 

Six  operations  are  required: 

1.  Input  of  edge  trace  function  and  auxiliary  data 

2.  Smoothing  of  D(x)  to  eliminate  fluctuations  due  to  film  grain 

3.  Computation  of  the  line  spread  function 

4.  Computation  of  the  transfer  function 

5.  Computation  of  the  passband 

6.  Outputs:  the  edge  trace  function  both  before  and  after  smoothing,  the 
line  spread  function,  passband,  transfer  function,  and  auxiliary  data. 
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The  following  is  a  description  of  each  of  the  six  operations. 


Inputs 

The  primary  input  is  the  data  set  which  is  the  sampling  of  the  edge  trace 
function  (Figure  20).  The  samples  are  equally  spaced  in  x  and  the  values  of 
D(x)  lie  within  the  interval  0  <  D(x)  <  4.  Each  of  the  values  of  D(x)  is  ex¬ 
pressed  to  the  nearest  thousandth  (for  example,  Dfx^)  =  2.  563).  The  number  of 
samples  (N)  is  the  order  of  50,  where  the  value  of  N  can  be  different  for  each 
edge  trace  function. 

In  addition  to  the  sampling  of  D(x),  auxiliary  data  is  required  as  input. 
These  are: 

(a)  The  value  of  the  parameter  y  (film  gamma)  used  in  the  calculation 
of  the  line  spread  function  (Operation  3).  This  parameter  lies 
within  the  interval  -10  <  y  <  10  and  is  expressed  to  the  nearest 
hundredth  (for  example  y  =  2.  54). 

(b)  The  value  of  Ax  (in  millimeters)  between  successive  density  data 
points.  This  value  will  lie  within  the  interval  0.  01  >  Ax  >  0.  00001 
and  should  be  given  to  three  significant  figures. 

(c)  Parameters  useful  for  data  smoothing  (Operation  2) .  It  may  be 
desired  to  specify  parameters  such  as: 

1.  Weighting  parameters 

2.  Initial  values  to  start  an  iterative  fitting 

(d)  Identification  is  included  for  each  case. 

Data  Smoothing 

The  smoothing  of  the  edge  trace  function  is  left  as  a  subroutine  in  order 
that  the  entire  computer  program  need  not  be  rewritten  when  improved  smooth¬ 
ing  routines  are  developed.  Two  alternative  smoothing  programs  have  been 
investigated  and  tested. 

1.  least  squares  fitted  polynomial 

2.  linear  filtering 


I 


3.0 


I 


Ai  ISM30 
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Figure  20.  Sampling  of  Edge  Density  Trace 


In  each  case  the  input  data  consist  of  the  set  of  sampled  densities  and  auxiliary 
parameters  where  needed.  The  output  consists  of  the  smoothed  density  set  and 
the  smoothed  values  of  the  derivative  of  the  density  since  both  of  these  are 
needed  to  compute  the  line  spread  function.  In  addition,  the  difference  between 
the  smoothed  and  unsmoothed  densities  at  each  point,  and  the  values  of  certain 
parameters  determined  by  the  smoothing  are  included. 

The  first  routine  yields  a  set  of  smoothed  densities  of  which  the  value  at 
the  kth  sample  point  [  Dy  (xjj  ]  can  be  given  by: 

M 

w  Vk 

1  =  0 


where  x^  is  the  value  of  x  corresponding  to  the  kth  sample  point.  Since  the 
sample  points  are  equally  spaced,  a  more  convenient  form  for  the  polynomial 
is  used, 


M 

<*k> 

1  =  0 


along  with  the  derivative: 


M 


3  =  1 


The  variable  x^  can  be  written 
xk  =  (  k  -  1)  Ax 
Thus: 

dk  1 
dx^.  Ax 
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T 

Therefore,  the  derivative  D  (x^)  becomes: 


M 


Vxk>  =  AT  2  ^i^’1 


j=l 


The  a's  are  determined  by  minimizing  the  square  error  (e )  in  fitting  the  poly¬ 
nomial.  This  error  is  written  as  the  sum  of  three  parts: 


«  ■  Vl  +  W2C2  +  V3 


where  Wj  2  3  are  weighting  parameters  specified  by  auxiliary  input,  and 
e  1,2,3  are  respectively  the  square  errors  in  the  density,  the  derivative  of 


the  density  (end  points  excluded) ,  and  the  derivative  of  the  density  at  the  end 
points.  These  part  errors  are  given  by: 

N 

•.-E 

k  =  1 

[ D <%>  -  Vxk>]  2 

A  2 

e  „  =  A  x 

2 

2  <Xk) '  <Xk>]  2 
k  =  2 

A  2 

£3  =  A  X 

2  2 

Ds  (X1}  +  °s  (XN) 

where: 

D’  <xk>  s  j 

•L  D  (xk+o  (xk-i) 

( 2  —  k  -  N  -  1) 

0 

(k  =  1,  N) 

The  minimization  of  e  leads  to  M  +  1  equations, 

=  0  «  =  0, 1 —  m> 
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from  which  the  M  +  1  parameters  (a  j)  are  determined.  The  values  selected 
for  the  parameters  M,  Wlt  W2  and  W3  are  respectively  7,  1. 0,  0. 2,  and  5.  0. 

The  alternative  routine  (linear  filtering)  is  accomplished  by  convolving  the 
noisy  density  function  with  a  function  having  a  low  pass  characteristic.  Since 
the  smoothing  is  done  after  the  density  trace  has  been  sampled,  the  convolution 
is  written  as  a  weighted  summation  over  the  data  set: 

00 

Ds  <xk>  -  32  W  <«J)D<xk  -«)> 

j=-00 

Since  the  sample  points  are  equally  spaced,  is  given  as  above,  and  ^  is 
written: 

■  >Ax 

Therefore,  the  smoothed  density  becomes: 


The  weighting  function  was  selected  to  have  a  low  pass  characteristic,  an  ad¬ 
justable  cut-off  frequency  for  flexibility,  and  a  mathematical  form  convenient 
for  computer  programming.  The  function  selected  is: 


(-n  ^  j^n) 


(otherwise) 
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where  an  increase  in  the  integer  n  will  lower  the  cut-off  frequency.  The 
smoothed  density  now  takes  the  form: 


u 

T.  (n-  ljl  +  l)D(xk_j) 


Ds  <xk>  '  ^ 


V  (n  -  Ij  I  +  1) 


j=-n 

with  the  derivative  given  by: 


Da  <xk)  “{  -JX7  [Ds  (xk41>  -  Ds  <xk-l)] 


(2  —  k  —  N-  1) 
(k  =  1,  N) 


The  above  expression  for  Dg(xj{)  requires  D(xk)  be  known  when  k  <  1.  These 
density  values  correspond  to  points  lying  outside  the  sample  interval  and  are 
determined  by  artificially  assigning  them  one  value  which  is  the  average  of  the 
first  2n  +  1  points  within  the  sample  region: 


2  n+  1 


D<xk»  s  Yj  D<Xj) 


(k<  1) 


Similarly,  at  the  other  end  of  the  sample  region  D(x^)  must  be  known  for  k  >N: 


D(xk>  E  Y 

j  =  N- 2  n 


D(x.) 


(k  >  N) 


Computation  of  Line  Spread  Function 

The  line  spread  function,  L(x),  is  given  in  terms  of  the  continuous  density 
function  by: 


L(x)  = 


D  (x)  10 


D(x)/*y 


D+/v  -  D- / v 

y(Log10  e)  (10  10  ,y) 
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where: 

D'  (x)  =  ^ 

'  dx 

D+  =  density  limit  (x  —  <*>) 

D_  =  density  limit  (x  — -oo) 

In  terms  of  the  smoothed  set  of  density  values  the  line  spread  function  is 
written: 


L<xk)  =  \  y  (log  10  e) 


Computation  of  Passband 


d’  (xk)  10D<Xk)/y 


(1  -  k  -  N) 
(otherwise) 


The  passband,  Ne  ,  is  given  by 


i 


L  (x)  dx 


which  is  written  as  a  summation: 


E  t 


L  (xk) 


Computation  of  Transfer  function 

The  transfer  function,  r0  (u>)  ,  is  given  by: 
To  (w)  =  +  (T*(u)  t(w))1/2 


where: 


T(W) 


■  r 


j  j  \  1WX 

L  (x)  e  dx 
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These  expressions  can  be  written: 


T„("j  = + 


n 


(s’  *  *„!) 


1/2 


where: 


N 


a  =  Ax 
n 


^  L  (xk)  cos  (k  -  1) 


k=  1 


N 


b  =  Ax 
n 


L,V  sln  [ 

k=  1 


sin  |  (k  -  1) 


] 


CU  = 


2rn 


n  N  Ax 


It  is  desired  to  use  the  spatial  frequency  rather  than  the  angular  spatial 
frequency  cun.  These  are  related  by: 


Also,  the  exact  expression  for  the  line  spread  function  given  above  (discussion 
of  Operation  3)  includes  normalization  to  provide: 


L  (x)  dx  =  1 


which  also  yields: 


r(o)  =  1 


Since  the  summation  of  L  (x^)  Ax  only  approximates  the  integral,  the  value  of 
aG  and  therefore  tq  (0),  may  not  be  unity.  Therefore,  rQ  (o>  ).  should  be 
given  by: 


To  (u  ) 
n 


+ 


1/2 
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which  can  be  written: 


N 

£  L(xk) 


where: 


n 

*'n  “  NAx 

The  values  of  and  tq  (i>n)  are  determined  for  n  =  0, 1,  .  .  .  ,  N  -  1. 


Outputs 

The  output  includes  the  following: 

(a)  Identification 

(b)  The  final  values  of  fitting  parameters  involved  in  the  data  smoothing 
routine. 

(c)  The  value  of  y 

(d)  A  tabulation  of  x^,  D  (x^)  (raw  data),  D(xk)  (after  smoothing). 

AD^  and  L  (x^)  for  k  =  1,  2,  .  .  . ,  N. 

(e)  The  value  of  Ne 

(f)  A  tabulation  of  pn  and  t0  (^q)  for  n  =  0,  1,  .  .  . ,  N  -  1. 

For  all  parameters  that  have  units,  units  are  included  in  the  output  format. 
This  involves  Ne  (mm*l),  pn  (cycles/mm),  L(Xfc)  (mm"l)  and  xk  (mm). 
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APPENDIX  III 

FEASIBILITY  OF  OBTAINING  MEASUREMENTS  OF 
PHOTOGRAPHIC  IMAGE  QUALITY  FROM  DENSITY 
TRACES  OF  EDGES* 


1.  INTRODUCTION  AND  SUMMARY 


This  memorandum  presents  the  results  of  a  research  program  on  the 
feasibility  of  obtaining  measurements  of  photographic  image  quality  from 
density  traces  of  edges. 

The  measures  of  image  quality  sought  are  "resolution",  which  corresponds 
to  the  value  of  spatial  frequency  at  which  the  transfer  function  has  dropped  to  a 
specified  value,  and  "passband" ,  which  is  the  area  under  the  square  of  the 
transfer  function.  It  is  the  purpose  of  this  report  to  determine  the  errors  in¬ 
curred  in  these  measures  when  certain  approximations  are  made. 

The  determination  of  these  two  measures  require  the  comparison  of  an 
"object  function"  occurring  in  the  real  scene  to  the  corresponding " image 
function"  in  the  film  transparency.  Since  known  test  charts  are  absent  from 
operational  aerial  photographs,  simple  functions,  such  as  "points",  "lines", 
or  "edges"  must  be  sought  and  recognized.  True  points  and  lines  of  finite 
intensity  in  the  real  scene  are  completely  lost  in  the  image  but  edges  are  not. 
Therefore,  "degraded  edges"  in  the  image  are  used  to  obtain  the  two  measures 
of  interest. 

Two  approximations  are  considered;  the  first  assumes  the  edge  trace 
function  is  known  for  all  values  of  x  but  the  expressions  relating  this  function 
to  the  quality  measures  are  approximate,  and  the  second  assumes  the  edge 
trace  function  is  known  only  for  a  finite  range  in  x. 

The  first  approximation  is  considered  because  the  calculation  of  the  trans¬ 
fer  function  from  the  density  trace  is  a  rather  time  consuming  procedure  when 
the  exact  mathematical  relation  is  used.  If  the  edge  is  of  low  contrast,  how¬ 
ever,  a  much  simpler  expression  is  available,  which  does  not  depend  on  film 
gamma,  and  the  first  case  to  be  considered  is  the  application  of  this  expression 
to  edges  of  high  contrast  and  the  resulting  errors  in  the  resolution  and  passband 


* 

This  appendix  represents  CAL's  internally  sponsored  research. 
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The  second  approximation  is  necessary  because,  in  practice,  a  micro¬ 
densitometer  trace  of  an  edge  is  terminated  at  both  ends,  since  edges  in  real 
scenes  cannot  be  traced  at  large  distances  from  the  position  of  the  step  without 
interference  from  other  objects  in  the  scene  format.  The  terminated  trace, 
therefore,  only  approximates  the  true  density  function.  The  errors  resulting 
in  the  resolution  and  passband,  due  to  this  approximation,  are  considered. 

The  first  approximation  results  in  simpler  mathematical  relations  linking 
the  resolution  and  passband  to  the  density  trace  of  an  edge.  The  resulting  value 
for  resolution  is  always  lower  than  the  true  value  with  the  error  ranging  from 
0%  at  low  contrast  to  20%  at  high  contrast.  The  error  introduced  into  the  pass- 
band  is  shown  to  depend  explicitly  on  the  form  of  the  transfer  function,  although 
upper  and  lower  bounds  have  been  determined.  In  addition,  the  passband 
errors  were  determined  for  an  exponential  transfer  function,  a  gaussian,  and 
for  the  transfer  function  corresponding  to  a  square  pulse  line  spread  function. 
For  all  cases,  the  error  in  the  passband  is  considerably  less  than  the  bounds 
indicate. 

The  resultant  errors  in  the  resolution  and  passband  using  the  low  contrast 
expression  and  the  error  in  the  resolution  using  the  exact  expression  have  been 
determined  for  various  terminated  edge  traces.  Closed  form  density  func¬ 
tions  were  derived  from  a  transfer  function  consisting  of  a  linear  superposition 
of  an  exponential  and  a  gaussian  and  the  density  functions  terminated  by  visual 
inspection.  For  all  cases  the  approximate  values  were  greater  than  the  true 
values,  with  the  error  being  negligible  for  a  high  ratio  of  passband  to  resolu¬ 
tion,  and  ranging  up  to  20%  for  the  resolution  and  40%  for  the  passband  for  a 
low  ratio. 


2.  LOW  CONTRAST  APPROXIMATION 

When  the  exposure  range  is  assumed  to  lie  on  the  linear  portion  of  the  D- 
log  E  curve,  the  line  spread  function,  L  (x),  can  be  expressed  exactly  in  terms 
of  a  density  trace,  D  (x),  of  an  edge  by: 


L(x) 


Dfx)  -  Dq 


D  (x)  e 


y 


-l 


) 


(i) 
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Where:  AD  =  P|  "  &o 

P,  =  density  limit  (X-*a*  ) 

D0  =  density  limit 

Y  =  /0<loSio^-  )  [  =film  "gamma"] 

PW= 

If  the  edge  is  of  low  contrast  (^r-0  ),  the  exponentials  of  Eq.  (1)  can  be 
expanded,  and  the  higher  order  terms  dropped  allowing  L  (x)  to  be  written: 


The  approximation  results  in  a  simple  expression  for  L  (x)  which  is  inde¬ 
pendent  of  the  film  gamma,  and  therefore,  it  is  of  interest  to  know  the 
accuracy  with  which  certain  image  quality  measures  are  determined  due  to 
using  La(x)  in  place  of  L  (x),  for  all  practical  values  of  .  The 

quality  measures  to  be  considered  here  are  "resolution"  (R)  and  "passband" 
(N)  defined  by*: 


oo 

*  =  3*j  VMJto  -  Ho) 

-00 


(3) 


=  j  CM  dp 

«  0* 


(4) 


These  quantities  are  similar  to  the  "Strehl  Intensity"  (which  correlates 
roughly  with  most  measures  of  resolution)  and  Schade's  "equivalent 
passband",  respectively.  Although  "resolution"  can  be  defined  in 
other,  ways,  the  form  of  Eq.  (3)  is  used  for  mathematical  convenience. 
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where  the  position  of  the  edge  in  the  undcgraded  scene  corresponds  to 
x  =  o,  and  (u>  )  (system  transfer  function)  and  L  (x)  are  a  Fourier 
transform  pair: 

oo 

L-(*)  ~  I  r(uj)  e‘u'*Jio  (5) 

- 

The  accuracy  of  these  measures  will  be  expressed,  in  each  case,  as  the 
ratio  (  F  )  of  the  approximate  to  the  exact  value: 

rr  La(°* 

=  t Sr  ,6> 


(7) 


a.  Determination  of  FR 


Using  Eqs.  (1)  and  (2),  Eq.  (6)  becomes: 


Where:  2  =  '~Jr~ 

In  general,  since  the  exact  position  of  the  edge  is  unknown,  D(0  )  and  there¬ 
fore  Fr  cannot  be  evaluated.  However,  if  L  (x)  is  restricted  to  be  sym¬ 
metric*  [  L  (x)  =  L  ( — x)],  D  (o)  can  be  found.  Since  L  (x)  is  normalized, 

* 

This  restriction  is  reasonable,  since  line  spread  functions  for  practical 
systems  are  usually  approximately  symmetric. 
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(9) 


|  L(x)  dX'  =  I 
•x» 


and  symmetric  L  (x)  allows  Eq.  (9)  to  be  written: 

oO 

1 1 lx)  Jx-  -  Ya. 

o 

Substituting  L  (x)  from  Eqs.  (1)  in  Eq.  (10),  and  integrating: 

m-Po 

e  f  +  / 


(10) 


(in 


Combining  Eqs.  (8)  and  (11)  yields: 


F  is  plotted  as  a  function  of  j?  in  Fig.  (1)  an^  it  is  seen  that  the  resolution 
as  determined  by  using  the  low  contrast  approximation  is  less  than  the  true 
resolution.  The  determination  of  the  approximate  resolution  involves  only 
the  measurement  of  D(o)  and  AD  which  are  obtained  from  a  density  trace 
that  is  known  for  all  values  of  x.  If  the  value  of  f  is  also  known  the  exact 
value  of  resolution  can  be  found  by  correcting  the  approximate  value  with 
the  aid  of  the  curve  in  Fig.  (1),  or  Eq.  (12).  If  If  is  not  known  exactly,  but 
upper  and  lower  bounds  can  be  placed  on  its  value  (which  also  places  bounds 
on  2r  ),  some  correction  is  still  possible  by  as  aiming  an  average  value 
for  2  .  Since  the  error  in  resolution  varies  slowly  with  , 

widely  separated  bounds  on  this  parameter  will  not  prevent  an  accurate 
determination  of  the  true  resolution. 

Even  if  if  is  completely  unknown,  the  range  of  values  taken  by  Fr  can 
be  specified,  since  the  parameter  £  can  be  related  to  the  ratio  of  the 
exposures  (known  empirically  for  different ta rgets)  for  each  side  of  the  edge 
in  the  original  scene.  From  the  Hurtcr-Driffield  relation: 


D  -  K  Io?i)eE  *  ^ 
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2.0 
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the  parameter  »?  can  be  expressed: 

where:  E|  =  exposure  at  X  -  ^ 

E0  =  exposure  at  jC  z  -  oo 

Practical  exposure  ratios  can  be  found  by  considering  the  spectral  reflec¬ 
tance  of  various  natural  and  man-made  objects  that  will  give  rise  to  edges 
in  an  aerial  photograph.  Measurements  by  Krinov*  for  an  altitude  of  1000 
ft.  result  in  specific  values  of  2*  ,  and  these  are  included  in  Fig.  (1). 


b.  Determination  of  Fj^ 


Again  using  Eqs.  (1)  and  (2),  Eq.  (7)  becomes: 


(15) 


Although  the  integral  in  Eq.  (15)  cannot  be  evaluated  without  knowing  D  (x), 
upper  and  lower  bounds  can  be  placed  on  Ffg  by  setting  D  (x)  =  Do,  and  D  (x) 

=  Dj  respectively.  Better  upper  and  lower  bounds  can  be  placed  on  Fj\j 
when  L  (x)  is  again  restricted  to  be  symmetric.  That  is,  since  p  (o)  is  known 
for  symmetric  L  (x),  the  integral  of  Eq.  (15)  can  be  written  as  the  sum  of 
two  integrals;  one  for  X><0  and  the  other  for  k?o  .  An  upper  bound  on  F [\j 
can  be  set  by  the  condition: 


P/*)  - 


(tc?o) 


(16) 


and  similarly  a  lower  bound  on  FN  can  be  set  by  the  condition: 


V  be)  = 


(xco) 

(X70) 


(17) 


-J- - 

Handbook  of  Geophysic  s,  A.  F.  Cambridge  Res.  Center  Chapter  1*1 
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Using  these  conditions  (Eqs.  (16)  and  (17)  and  the  value  of  D  (  0  )  from  Eq.  (11)), 
the  bounds  are  calculated  from  Eq.  (15): 


(5 


-  2  -29 

xe  +e. 


i  .  j  j  \ 


(18) 


Each  bound  is  plotted  as  a  function  of  i  in  Fig. (2).  These  bounds,  unfortu¬ 
nately,  diverge  rapidly  for  increasing  ? .  This  does  not  mean,  however, 
that  can  deviate  from  unity  by  these  amounts.  Better  bounds  should  exist 
because  it  seems  reasonable  that  the  least  upper  bound  and  the  greatest  lower 
bound  should  have  zero  slope  at  2*0. 

Since  the  bounds  that  have  been  determined  allow  the  possibility  of  very 
large  errors  in  the  passband  value,  F^(  2  )  has  been  computed  for  three  speci¬ 
fic  line  spread  functions  which  are  a  square  pulse,  a  Gaussian,  and  the  line  spread 
corresponding  to  an  exponential  transfer  function.  Except  for  the  Gaussian,  these 
functions  are  included  in  Fig.  (2).  The  Gaussian  is  not  plotted  since  the  inte¬ 
gration  in  Eq.  (15)  could  not  be  accomplished  in  closed  form  and  only  two  points 
(  -2-  =  0.69,  2.00)  were  found  by  numerical  integration.  The  two  values,  although 
subject  to  error,  indicate  that  F^  (  2  )  for  the  Gaussian  is  much  closer  to  unit 
than  either  of  the  other  two  cases. 


3.  TERMINATED  DENSITY  TRACE 

In  practice,  the  density  trace  of  an  edge  must  be  terminated  at  both  ends 
in  order  to  avoid  interference  from  other  nearby  objects  in  the  scene  format, 
and  it  is  the  purpose  of  this  section  to  determine  the  resulting  errors  in  the 
measures  of  resolution  and  passband.  Since  the  decision  of  where  the  trace 
should  be  terminated  is  made  by  visual  inspection  of  the  trace,  the  procedure 
used  here  to  determine  the  errors  was  to  calculate  the  resolution  and  passband 
from  a  visually  terminated  density  trace  and  compare  these  results  to  the  corre¬ 
sponding  values  for  the  unterminated  trace.  For  the  theoretical  comparison,  a 
convenient  way  of  providing  density  traces  with  known  resolution  and  passband  is 
to  derive  them  from  a  transfer  function  expressed  in  closed  form.  Therefore,  a 
digression  is  in  order  to  find  a  realistic  analytic  form  for  T (to) . 
ks  a  starting  point,  the  following  form  is  considered: 

—  lu)l  ,  -  UJ1'  fiQ| 

rM=*e  +(i-«)e 
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03 


Figure  2  ERROR  IN  PASSBAND 


This  generates  a  family  of  functions  in  the  parameter  o<  ,  each  of  which  has 
a  value  of  unity  at  U)zO  and  approach  zero  as  U)-*to0.  In  addition,  the  form 
is  simple,  and  the  resolution  and  passband,  as  given  by  Eqs.  (3)  and  (4),  can 
be  calculated  in  closed  form.  All  that  remains  is  to  assure  that  this  form 
will  provide  resolution  and  passband  values  consistent  with  those  found  in 
practice.  Both  the  resolution  and  passband  depend  upon  the  scale  of  Cl) 
identically,  and  thereore  scale  has  been  ignored  in  Eq,  (19).  What  is  impor¬ 
tant  is  the  "shape"  of  T (to)  ,  and  whether  a  significant  variety  of  shapes  is 
available  by  varying  o<  .  Fig.  (3)  is  a  plot  of  y(J)  U)  for  at  =0,  1,  and  2, 
and  the  resulting  shapes  are  seen  to  vary  considerably.  As  discussed  in  the 
final  report  on  Project  Q-CAR,  the  ratio  of  passband  to  resolution  is  inde¬ 
pendent  of  scale  factor  and  is,  therefore,  useful  as  a  measure  of  shape. 

The  <4  values  in  the  range  0-2  provide  N/R  values  that  agree  with  those 
found  in  practice,  and  ,  therefore  the  form  of  V(uJ>)  given  in  Eq.  (19)  will  be 
considered  suitable  for  providing  realistic  density  traces. 

The  errors  introduced  in  Rand  N  due  to  knowing  D  (x)  only  over  a 
finite  range  of  %  can  be  related  to  the  error  in  the  density  difference  of  the 
edge  due  to  terminating  D  (x).  Both  the  low  contrast  expression,  Eq.  (2), 
and  the  high  contrast  expression,  Eq.  (1),  are  considered.  First,  the  errors 
in  R  or  N  will  be  expressed  in  terms  of  the  error  in  the  density  difference 
for  these  cases.  Finally,  density  traces  corresponding  to  a  transfer  function 
similar  to  Eq.  (19)  are  plotted  from  which  realistic  errors  in  AD,  and  hence, 
in  Rand  are  determined. 

The  low  contrast  resolution  as  defined  by  Eqs.  (2)  and  (3)  can  be 

written: 

o  . 

ap  <20> 


If  D  (x)  is  not  traced  for  a  large  enough  range  of  x,  only  an  approxi¬ 
mate  density  difference  (Aa[?)  is  known,  and  the  error  in  R  can  be  expressed 
by:* 


H  '  A,p 


(21) 


The  ratios  and  used  from  here  on  should  not  be  confused  with 

and  Fm  discussed  earlier  since  the  approximations  are  of  different  nature. 
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For  an  edge  of  high  contrast,  the  exact  expression  for  the  resolution 
is  used.  From  Eqs.  (1)  and  (3)  this  can  be  written: 

Dio)  -  D0 

p'to)  e  1 


R  = 


1>-t) 


(22) 


For  symmetric  L  (x),  Eqs.  (11)  and  (22)  are  combined  to  give: 

R  _  _£?£)  /  i 


(23) 


Again,  if  is  given  approximately  by  (and  consequently  ?  by  ZA  )  the 
ratio 


can  be  found  from  Eq.  (23): 

*  j  ~~  ±^{Wsl) 


(24) 


It  should  be  pointed  out  that  if  ^Pis  not  known  exactly,  the  position 
(Xr-O  )  on  the  density  trace  corresponding  to  the  edge  in  the  original  scene 
(determined  by  Eq.  (ll))is  also  inexact.  Although  this  implies  an  error  in 
D Co)  Eq.  (23),  this  error  is  ignored  since  realistic  line  spread  functions 
are  slowly  varying  at  X-0  . 

The  calculation  of  the  ratio  of  approximate  passband  (  N^)  to  exact 
passband  (N)  for  an  error  in  the  density  difference  is  more  difficult  than  for 
the  above  resolutions,  and  only  the  low  contrast  case  is  considered  here.  From 
Eqs.  (2)  and  (4)  the  low  contrast  passband  can  be  written: 


N  =  I  6* 


(25) 


-  Oo 


The  approximate  passband  is  obtained  by  integrating  over  a  finite  range  of  x 

b 


na  ^  Jo  I  D'l*Ux 


(26) 
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Where  AaD  =  0,-Q 

b  (X^, 


It  is  not  possible  to  evaluate  the  integral  of  Eq.  (26)  without  knowing  D  (  x)  , 
however,  upper  and  lower  bounds  can  be  found.  First,  Eq.  (26)  can  be 


written: 


Na  =  av 

*  A, 


CL 

OC  .  / 

-  [  -  D'/xJJt- 


An  upper  bound  is  obtained  by  letting: 


=  PU)Jx  -O 


Therefore,  from  Eqs.  (25),  (27),  and  (28): 


MAX 


A  0 

A.D 


A  lower  bound  results  from  rewritting  the  last  two  integrals  of  Eq.  (27)  and 
making  the  rea sonable  assumption  that  in  the  ranges  X*4.and  X>  b  j  )P/x)Jdecreases 
monotonically  as  X-  ■  These  integrals  can  then  be  written: 


a  uK 

(  v  (  / 

-  JP'dO  <  D  (d) 


P  - 


< 

o'do  <  o'uHo,-  Dt>) 


Eqs.  (25),  (27),  and  (30)  yield: 
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N 


D?a)(pa.-P0)  +pU)(D,-  Dj 


N  t&D 


(31) 


From  Eqs.  (29)  and  (31)  it  is  seen  that  the  right  hand  term  of  Eq.  (31)  is  the 
difference  between  the  two  bounds.  It  will  be  shown  below  that  for  reasonable 
terminating  points  this  term  is  small,  and  the  bounds  become  identical,  thereby 
determining 

In  order  to  obtain  a  feeling  for  the  magnitude  of  the  error  in  determining 
2^  V  ,  edge  dsnsity  traces  representing  low,  medium,  and  high  ratios  of  N/R 
are  plotted  in  Figs.  (4)  and  (5).  These  curves  were  derived  from  a  transfer 
function  of  the  form: 


-(Ihtflvl  -(In*)**? 

'Y(uj)  -  <*e  *#-  (i-«)e 


(32) 


The  curves  are  plotted  for  a  film  gamma  (  )  of  2,  and  density  differences 

(  AD  )  of  0.  60  (Fig.  (4)  and  1. 74  (Fig.  (5)).  In  each  case  the  ratio  N/R  is 
varied  by  allowing  oA  to  take  values  of  0,  1  and  2.  For  each  of  the  six  curves, 
estimates  of  the  terminating  points  were  made  by  visual  inspection.  These 
points  were  selected  in  the  same  regions  as  would  be  done  for  traces  from  real 
scenes  where  the  tails  of  the  traces  might  be  affected  by  the  presence  of 
neighboring  objects.  These  values,  along  with  the  resulting  ratios  for 

both  the  low  and  high  contrast  cases,  and  A/u  for  the  low  contrast  case,  are 
included  in  Table  (1).  With  regard  to  the  last  ratio  (  V*  ),  the  selected 
terminating  points  resulted  in  values  of  Dfa)  and  D(b)  small  enought  that 
the  last  term  of  Eq.  (31)  is  less  than  1/2%  of  the  first  term  for  all  six  cases. 
Therefore,  the  last  term  can  be  ignored,  which  results  in  identical  upper  and 
lower  bounds  on  the  parameter  .  Thus: 


N, 


A  _ 


N 


(33) 
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Figure  5  PER IVEr  DENSITY  TRACE*  (AD  -  1 .74) 
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4. 


RESULTS 


The  expression  derived  for  low  contrast  edges  provide^  a  simpi* 
relation  between  the  density  trace  and  the  line  spread  function  which  is  inde¬ 
pendent  of  film  gamma,  and  its  use  as  an  approximation  for  edges  of  higher 
contrast  results  in  th£  following  errors  in  resolution  and  passband- 

(1)  The  resultant  resolution  values  are  always  less  than  the 
true  values,  with  an  error  of  less  than  15%.  for  most  edges 
occurring  in  aerial  scenes. 

(2)  Errors  in  the  resolution  values  can  be  reduced  when  an  approxi¬ 
mate  value  of  film  gamma  is  known. 

(3)  For  sample  cases  considered,  the  resultant  passband  values  were 
in  error  by  less  than  20%,  however,  no  general  limits  could  be 
derived. 

The  errors  introduced  into  the  resolution  and  passband  values  by  a 
lack  of  knowledge  of  the  density  trace  far  from  the  edge  depend  on  the  error 
in  evaluating  the  total  density  difference  (AD  )  across  the  edge: 

(1)  The  error  in  estimating  AV  increases  as  the  ratio  of  passband 
to  resolution  decreases. 

(2)  The  %  error  in  the  resultant  resolution  is  equal  to  the  %  error  in 
A  D  ,  and  can  be  as  high  as  20%  for  the  lowest  practical  passband 
to  resolution  ratios. 

(3)  The  %  error  in  the  resultant  passband  is  equal  to  twice  the  %  error 
in  the  resolution  error. 

5.  CONCLUSION 

It  is  concluded  that,  within  the  accuracy  required  by  image  quality 
measures  for  most  applications,  an  edge  trace  is  a  good  source  of  these 
measures.  Moreover,  since  the  errors  resulting  from  the  use  of  the  low  con¬ 
trast  expression  are  comparable  to  those  created  by  the  termination  of  edge 
traces,  the  low  contrast  expression  can  be  used  whenever  convenient. 

6.  RECOMMENDATIONS 

(1)  At  present,  there  is  no  quantitative  criterion  for  selecting  termin¬ 
ation  points  of  a  density  trace.  A  method  should  be  developed  to  perform  this 
selection  and  the  resulting  errors  in  resolution  and  passband  re-evaluated. 
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(2)  Realistic  density  traces  should  be  examined  to  determine  if  the 
true  total  density  difference  can  be  correlated  with  the  behavior  of  the  trace 
in  the  sampled  region.  If  a  correlation  can  be  found,  the  error  in  the  density 
difference,  and  therefore  in  resolution  and  passband,  can  be  reduced. 
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